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DETAILED ACTION 

Response to Arguments 
1 . Applicant's arguments filed on 7/19/2004 have been fully considered but they are not 
persuasive. 

Regarding claims 1-4, 5-9, 12 and 13, the Applicant alleged in the page 8 of the remarks 
that "Garrett '41 1 does not teach "a combined display-camera having a plurality of display 
elements and a plurality of camera elements, the displav elements and camera elements 
comprising respective elements that are arranged substantially in a common plane with the 
display elements being interspersed with the camera elements." 

In response, the Examiner respectfully disagrees because Garrett '41 1 does in fact 
discloses a combined display-camera system (Fig. 2) having a plurality of display elements (i.e., 
Noted the display elements corresponding to Red, Green and Blue of the LCD display elements 
as shown in Figs. 4-6) and a plurality of camera elements (i.e.. The "X"s represent areas as 
shown in Fig. 4 is considered as "a plurality of camera elements" as claimed), the displav 
elements (i.e.. the LCD elements corresponding to the R, G and B filter areas within the LCD 
displav unit of Figs. 4/5) and camera elements (i.e.. the "X" elements on the LCD displav as 
shown in Figs. 4/5) comprising respective elements (i.e.. noted that the elements 160 and 120 
having other elements 150, 155. 165, 170 and 210 are considered as "respective elements" ) that 
are arranged substantially in a common plane (i.e., as shown in Fig. 5, that the elements 120, 
160, 190, and other elements are substantially arranged in a common plane) with the display 
elements (i.e., noted the display elements 160 corresponding to Red, Green and Blue of the LCD 
display device as shown in Figs. 4-5) being interspersed with the camera elements (i.e., noted the 
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elements represented by "X" on the LCD display device) as required by the presented claimed 
invention. 

In view of the above, the Examiner asserts that Garrett'41 1 does in fact anticipate the 
present claimed invention as recited in claims 1-4, 5-9, 12 and 13 at lest for the reasons discussed 
above, and Miyano and Meyers do cure the deficiencies of Garrett '411, thus, the Examiner will 
maintain the rejections as follows: 



Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

3. Claims 1-4, 5-9, 12 and 13 rejected under 35 U.S.C. 102(b) as being anticipated by 
Garrett etal. (GB 2,273,411). 

Regarding claim 1, Garrett '41 1 discloses an apparatus (i.e., see Figs. 1-6) for use in a 
image processing system (Fig. 7), the apparatus comprising: 

a combined display-camera (i.e., Fig. 2, the elements 50 and 60) having a plurality of 
display elements (i.e., see figs. 4) and a plurality of camera elements (i.e., Fig. 4; page 5, lines 5- 
10\ the displav elements (i.e.. i.e., the LCD elements corresponding to the R, G and B filter 
areas within the LCD display unit of Figs. 4/5) and camera elements (i.e., the "X" elements on 
the LCD displav as shown in Fig. 4/5) comprising respective elements (i.e., noted that the 
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elements 160 and 120 having other elements 150, 155, 165, 170 and 210 are considered as 
"respective elements" ^ that are arranged substantially in a common plane with the display 
elements (i.e., noted from Figs. 2, 5 and 6, the camera is arranged substantially in the same plane 
as the display device)being interspersed with the camera elements, and 

wherein each of at least a subset of the camera elements (i.e., see page 9, lines 20-25) has 
one or more imaging angles associated therewith, the one or more imaging angles being selected 
to provide a desired imaging operation for the combined display-camera (i.e., noted from Figs. 3 
and 5, the imaging angle of the camera is selected based on the viewing angle 1 10. Since there 
are an infinite number of viewing angles 1 10, it is cleared that more than one imaging angles can 
be selected to provide a desired imaging operation; see page 7, lines 20-39). 

Regarding claim 2, Garrett '41 1 discloses wherein at least a subset of the display 
elements comprise liquid crystal display elements (i.e., see page 8, lines 10+). 

Regarding claim 3, Garrett '41 1 discloses wherein at least a subset of the camera 
elements comprise charge-coupled device image sensors (i.e., see page 8, lines 25+). 

Regarding claim 4, Garrett '411 discloses wherein at least a subset of the camera 
elements comprise photosensors (i.e., page 9, lines 5+). 

Regarding claim 5, Garrett '41 1 discloses wherein a given one of the camera elements 
comprises at least a portion of a pair of coUimated plates (i.e., noted the parallel plate as shown 
in Fig. 5), and wherein an imaging angle is selected for the given camera element by establishing 
a corresponding positioning of holes in the collimated plates (i.e., see Figs. 3, 5 and 6; page 7, 
lines 20+ and page 8, lines 2+). 

( 
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Regarding claim 6, Garrett '41 1 discloses wherein the combined display-camera 
comprises a flat panel display (i.e., noted from Figs. 2 and 5, that the display panel 50 is flat). 

Regarding claim 7, Garrett '41 1 discloses wherein at least a subset of the plurality of 
display elements (Figs. 4 and 6) and at least a subset of the plurality of camera elements are 
arranged in an array which includes more display elements than camera elements (i.e., Figs. 4, 5 
& 6, page 8, lines 2+ and page 9, lines 20+). 

Regarding claim 8, Garrett '411 discloses wherein the one or more imaging angles are 
selected to provide an imaging operation for the combined display-camera (i.e.. Fig. 3, page 7, 
lines 20+) which approximates that of a lens-based single-camera system (i.e., page 3, lines 21+). 

Regarding claim 9, Garrett '41 1 discloses wherein the one or more imaging angles are 
selected to provide an imaging operation for the combined display-camera (i.e., Fig. 3, page 7, 
lines 20+) which approximates that of a pin-hole camera system (i.e., see page 4, lines 20+). 

Regarding claim 12, Garrett '41 1 discloses a method for use in an image processing 
system (i.e., Figs., 1-7), the method comprising the steps of: 

providing a combined display-camera having a plurality of display elements and a 
plurality of camera elements (Fig. 4; col. 4, lines 15-40), the display elements (i.e., the LCD 
elements corresponding to the R, G and B filter areas within the LCD display unit of Figs. 4/5) 
and camera elements (i.e.. the "X" elements on the LCD display) comprising respective elements 
(i.e., noted that the elements 160 and 120 having other elements 150, 155, 165. 170 and 210 are 
considered as "respective elements" ) that are arranged substantially in a common plane (i.e., 
Figs. 2 and 5) with the display elements being interspersed with the camera elements (i.e., noted 
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from Figs. 2, 5 and 6, the camera is arranged substantially in the same plane as the display 
device), and 

wherein each of at least a subset of the camera elements has one or more imaging angles 
associated therewith (i.e., see Fig. 3 and page 9, lines 20+); and selecting the one or more 
imaging angles to provide a desired imaging operation for the combined display-camera (i.e., 
noted from Figs. 3 and 5, the imaging angle of the camera is selected based on the vicAving angle 
110. Since there are an infinite number of viewing angles 1 10, it is cleared that more than one 
imaging angles can be selected to provide a desired imaging operation; see page 7, lines 20-39). 

Regarding claim 13, Garrett '41 1 discloses an article of manufacture (Figs. 1-6) 
comprising: a storage medium (Fig. 7, the elements 240 and 260) for storing one or more 
programs for use in an image processing system (i.e., page 6, lines 5+ and page 9, lines 15+), the 
image processing system including a combined display-camera having a plurality of display 
elements and a plurality of camera elements (Fig. 4; col. 4, lines 15-40), the displav elements 
(i.e.. the LCD elements corresponding to the R. G and B filter areas within the LCD display unit 
of Figs. 4/5) and camera elements (i.e., the "X" elements on the LCD displav) comprising 
respective elements (i.e., noted that the elements 160 and 120 having other elements 150, 155. 
165, 170 and 210 are considered as "respective elements" ) that are arranged substantially in a 
common plane with the display elements being interspersed with the camera elements(i.e., Figs. 
2 and 5), and 

wherein each of at least a subset of the camera elements has one or more imaging angels 
associated therewith (i.e., see Fig. 3 and page 9, lines 20+), wherein the one or more programs 
when executed by a processor (i.e., Fig. 7, the element's 250; and page 9, lines 15+) implement 
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the step of selecting the one or more imaging angles to provide a desired imaging operation for 
the combined display-camera (i.e., noted from Figs. 3 and 5, the imaging angle of the camera is 
selected based on the viewing angle 1 10. Since there are an infinite number of viewing angles 
1 10, it is cleared that more than one imaging angles can be selected to provide a desired imaging 
operation; see page 7, lines 20-39). 



Claim Rejections - 35 USC § 103 
4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the 
claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of the various 
claims was commonly owned at the time any inventions covered therein were made absent any 
evidence to the contrary. AppUcant is advised of the obligation imder 37 CFR 1,56 to point out 
the inventor and invention dates of each claim that was not commonly owned at the time a later 
invention was made in order for the examiner to consider the appUcability of 35 U.S.C. 103(c) 
and potential 35 U.S.C. 102(e), (f) or (g) prior art under 35 U.S.C. 103(a). 
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5. Claim 10 is rejected under 35 U.S.C. 103(a) as being unpatentable over Garrett '41 1 in 
view of Miyano (U.S. 5,610,390). 

Regarding claim 10, it is noted that Garrett '41 1 does not explicitly stated that the camera 
comprises a set of angles including a horizontal angle ttx tan'* (x/d) and a vertical angle tty = 
tan"* (y/d), where x and y denote the horizontal and vertical distance from the camera to the 
optical axis of the combined display-camera, and "d" is the distance from an image plane of the 
combined display-camera to a desired virtual focus point of the combined display-camera. 

However, the above-mentioned claimed invention is conventional well known geometric 
principle for determining an acute angle value. For example, it is basic well known teaching of 
trigonometric function that the ratio of the length of the side opposite the angle to the length of 
the side adjacent to the angel is used to obtain an acute angle in a right angle triangle. In view of 
this, it is cleared form Figs, 2 and 3 that the tangential angles of an imaging elements of the 
camera 60 (i.e., see Fig. 3 and page 7, lines 20+) positioned in the horizontal plane in "X" 
direction and the vertical plane in "Y" direction (i.e., noted that camera 60 is positioned in the 
"xy" plane as shown in Figs. 2 and 3 of Garrett '411) obviously contain the angles tan a (x, y) = 
Length of the side opposite (i.e., x for "X" plane and y for "Y" plane)/Length of the side 
Adjacent to the angel (i.e., the focal length of the camera). In view of this it is obvious to include 
the angel a (x. y) = tan"* (the horizontal x or vertical y values)/(the focal length of the camera) in 
the camera system of Garrett '411, and this is fiirther evidenced the teaching of Miyano '390. 

Moreover, Miyano '390 teaches the above-mentioned well known trigonometric fimction 
for determining the tangential angel of the camera (see Figs. 3 A-3C; col. 3, lines 60+ and col. 4, 
Imes 5+) where the angle of the camera (9) = tan'* (the length "h")/(the length H). In view of 
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this, it is obvious that the camera (60) of Garrett '41 1 may include one horizontal angle such that 
Ox ^ tan'' ("h" in horizontal direction)/(the focal length of "H") and one vertical angle such that 
0y = tan"' ("h" in vertical direction)/(the focal length of "H") as suggested by Miyano '39. 

In view of the above, having the system of Garrett '41 1 and then given the well- 
established teaching of Miyano '390, it would have been obvious to one having ordinary skill in 
the art at the time the invention was made to provide well known set of camera angles as taught 
by Miyano '390, since Miyano '390 states at col. 2, lines 1+ that such a modification would 
provide a high quality image over the entire pixel constituent element of a solid-state image 
pickup element and improve the pixel opening. 

6. Claim 1 1 is rejected under 35 U.S.C: 103(a) as being unpatentable over Garrett '41 1 in 
view of Meyers (U.S. 6,137,535). 

Regarding claim 11, Garrett '41 1 discloses wherein each of at least a subset of the camera 
elements has a plurality of image sensor associated therewith, and different perspectives of a 
scene can be generated in the image processing system (i.e., Figs. 4, 6 and 7; page 9, lines 15+). 

Furthermore, it is noted that Garrett '41 1 does not explicitly state that different imaging 
angles can be set for the different image sensors of a given camera element as recited in present 
claimed invention. 

However, the above-mentioned claimed limitations are well known in the art as 
evidenced by Meyers '535. In particular, Meyers '535 teaches that it is conventionally well 
known to set the different imaging angles for the different image sensors of the given camera 
element to provide a different segment of a total field of view (Figs. 1 A, 2 and 9; noted the 
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different imaging angles set for different image sensors of the camera; see col. 1, lines 15+, col. 
3, lines 30+ and col. 4, lines 45+). 

In view of the above, having the system of Garrett '41 1 and then given the well- 
established teaching of Meyers '535, it would have been obvious to one having ordinary skill in 
the art at the time the invention was made to modify the system of Garrett '41 1 as taught by 
Miyano '390, since Miyano '390 states at col. 3, lines 35+ that such a modification would 
provide a different segment of a total field of view. 

Conclusion 

7. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

a. Amomori '674 shows a combined display device (i.e., LCD 26) and the camera 
(i.e., the CCD 17) to provide a desired imaging operation for the combined display- 
caniera thereof 

8. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
AppUcant is reminded of the extension of time policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS fi-om the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
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CFR 1.136(a) will be calculated from the mailing date of the advisory action, hi no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this commimication or earlier communications from the 
examiner should be directed to Aung S. Moe whose telephone number is 703-306-3021. The 
examiner can normally be reached on Mon-Fri (9-5). 

If attempts to reach the examiner by telephone are unsuccessfiil, the examiner's 
supervisor, Wendy Garber can be reached on 703-305-4929. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Liformation Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
appUcations is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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